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Background: 
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•  Research  has  shown  that  in  a  group  decision 
making  environment,  members  usually  discount 
any  uniquely  held  information  that  gets  shared 
with  the  group.* 

•  This  shared,  uniquely  held  information  typically 
does  not  significantly  impact  the  final  decision. 

-  “You  can  lead  a  group  to  information,  but  you  can’t 
make  it  think.”** 

•  Why  is  this  true? 


*Stasser  et  al,  85,  96,  98 
**Dennis,  1996 


Hypothesis 
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•  (1)  A  group  member  already  has  a  high 
cognitive  burden  in  processing  the  information 
he  has  found. 

•  (2)  Shared  information  from  other  members 
usually  arrives  in  an  unprocessed  form: 

-  “Here’s  a  relevant  report  you  should  read” 

•  (3)  The  new  information  is  not  integrated  into  the 
decision  process  because  it  causes  too  great  of 
a  cognitive  burden  on  the  recipient. 


Approach 
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•  Exchange  processed,  subjective 
assessment  information: 

-  “Read  this  report”  vs. 

-  “Read  this  report  if  you  wish.  I  found  that  this 
report  has  high  credibility,  the  information  is 
timely,  backed  up  by  facts,  is  of  high  importance 
and  has  a  strong  negative  effect  on  use  of 
option  C.  ” 

-  How  do  we  encapsulate/displav  these 

subjective  assessments? 


Information  Object  (IOB) 


SflAWAR 

V 

Systems  Center 
San  Dieg  o 


An  IOB  is  an  iconic  encapsulation 
of  the  subjective  assessments  an 
individual  has  assigned  to  a 
particular  information  item. 

It  is  automatically  created  from  an  abstraction 

template. 

It  is  analogous  to  military  tactical  symbology. 

IOB  Representation 

Original  Qf  subjective  assessments 

document 

■= 


lOBs  Convert  IMPLICIT 

subjective  estimates  into  EXPLICIT  estimates. 
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SPECIAL  REPORT 

THE  STERILE  AIRPORT 

Near-total  airport  security  is  possible. 
Technologies  are  in  sight  to  seal  the  leaks,  spot 
the  bad  guys,  find  the  bombs. 

by  Dan  Tynan 


H2I3I1 

AIRPORT  SECURITY  FORTHE  9/11  AGE 

Recent  dummy-weapon  tests  at  airports  show  it's 
still  possible  to  get  guns  through  security,  here's 
how  a  super-secure  airport  would  work. 


save  this  email  this  print  this  most  popular 


We  asked  Isotec  Inc.,  a  Denver-based  security 
systems  design  firm,  to  help  us  engineer  an 
airport  that  would  target  terrorists  without 
gumming  up  passenger  traffic.  We  also  sought 
input  from  CompuDyne  Corp.,  Viisage 
Technology,  General  Defense  Systems,  and  other 
companies  that  make  and  install  security 
equipment,  In  this  exercise,  money  was  no 
object;  safety  was  our  only  concern. 

We  set  a  target  date  of  five  years  from  now.  But 
much  of  the  technology  is  available,  or  will  be 
very  soon.  The  goal!  Every  person,  every  bag, 
and  all  supplies  and  equipment  in  an  airport  will 
be  tagged,  tracked,  and  instantly  locatable. 

~  1.  CHECK-IN  AND  SECURE  ID 


Initial  safeguards  appear  a  mile  outside  the 
airport.  Scanners  at  tollbooth-like  structures 

jalnnn  arrs??  rnjarU  aim  th»ir  Ijaspr  ?rannar?  a*t 


Credibility? 

M'W  r  I  r  |  r 

Effect/Impact? 

M'W  r  I  r  |  r 

Importance? 


Timeliness? 


r  |  r  | ~F 


Encapsulate  the  scores  into  an  IOB  that  displays  information 
quality,  impact  and  importance 


Effect/Impact:  2olorr 

!TtHH£AIRPORT 

Quality 

of  information  - 

#68  CRED  TIME  CONF 

Informationllmportance: 
Size  of  color  bar  (1 ,  2  or 
3  sections  filled) 


IOB 


IOB  creation  process 
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Title: 

Criterion: 

Credibility: 


C  HIST  C  ADMN  C  GAIN 

V.  High/Good 


V.Low/Poor 


1 :  Select  document  for  retention 


Title:  j  growth 

Criterion:  r*  hist  r  admn  <*■  gain  r  prob 

V.Low/Poor  A>rg.  V.  High/Good 

Credibility: 

Timeliness: 

Confidence: 


& 
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?  r  ? 


9  C  7 


V.Neg. 


Neutral 


Effect: 

Importance: 


V.Pos. 

['■Tr? 


Discard  (1)A»rg.  (2)High  (3^.  High 


Submit 


Reset 


Close 


Step  2:  Activate  Abstraction  Template 


Step  3:  Complete  Assessment 


Software  creates  and 
stores  an  Information  Object 
(IOB)  in  designated  database 


growth 


GAIN  M2 
#32 


TIME 


CRED 


CONF 


The  decision  environment: 


BBC  NEWS 


ADMNM2 

*68  CREO  tme  CONF 


STEWLE  AIRPORT 

ADMN  M2 

*68  CREO  Ti* 


Take  action  A? 


Take  action  A? 


Documents  vs  lOBs 
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Integration  of  Shared  Information 
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“Here’s  more...” 


ft.  r«  look 

j  .a  a 
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Member  already  has  a 
r  high  cognitive  burden. 
v±  What  is  the  likelihood 
5  these  will  be  integrated 
g  into  his  decision  process? 


Administration 
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Submit  1 

Overall  Criterion  Score:  BM 
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Industry  Projects  Index 


TPS  Reports 


Red  Tape 


LMT 


ADMN  M2 
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TIME 


CONF 


ADMN  M2 
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consent  agree 


Memo  1 


ADMN  M2 
#29 


CRED  TIME 


ADMN  M2  #2 
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CRED  TIME 


CONF 


ADMN  M2 
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CRED  TIME  CONF 


“Here’s  more. 


Domestic  Shinning 


#26  CRED  TIME  CONF 


Globalization 


HISTM4 
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Research  Question: 
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•  lOBs  may  be  a  convenient  way  of 
exchanging  subjective  assessments  about 
an  information  item,  but . 

Does  the  use  of  IQBs  improve  decision 

making  performance? 


PG  School  Experiment 
18  Officers 
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•  Display:  Text  vs.  lOBs 
•  Decision:  Positive*  vs.  Negative* 


Positive 

Decision 

Negative 


Display 


Text  Only 

lOBs 

N=5 

N=5 

N=4 

N=4 

N=9 

N=9 

N=10 


N=8 


N  (tot)=18 


*Positive  =  Yes,  use  Islandia  Negative  =  No,  don’t  use  Islandia 


Task: 
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•  Volcanic  disaster  in  the  Pacific 

•  Should  we  recommend  Islandia  as  the  refugee 

site? 

•  Sees  30  information  items  (randomized) 

-  5  decision  criteria 
•  6  items  per  criteria 


The  Five  Decision  Criteria 
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[  COMmunications  -  TSPortation  -  LAB  or  ADMistration  -  SANitation  ] 

•  Communications  Facilities  (COM) :  As  s  e  s  s  th  e  c  o  m  m  u  n  i  c  ati  o  n  fa  c  i  I  iti  e  s  th  at 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

•  T ransportation  Facilities  (TSP) :  As  s  e  s  s  th  e  tra  n  s  p  o  rtati  o  n  fa  c  i  I  iti  e  s  th  at  a  re 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

•  Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

•  Administrative  Requirements  (ADM):  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 

•  SanitationMealthlUledical  conditions  (SAN):  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


Decision  Tasks 
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£iumr 


Reset  't 


5  Criteria  Decisions, 
1  Overall  Decision 


Text  Condition  (9  subjects) 
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1/30 


....A  cultural  tradition  in  Islandia  is  that  each  worker  is  given  a  single  two  month 
vacation  each  year,  which  he  can  take  anytime  during  the  year.  All  the  employee  has  to 
do  is  give  the  employer  a  one  week  notice  before  going  on  vacation.  This  has  caused 
unexpected  and  disrupted  work  shortages  when  several  employees  elect  to  take  the 
vacation  at  the  same  time.... 


<C 


Criterion: 

COM 

r 

TSP 

c 

LAB 

r 

ADM 

r 

SAN 

r 

Submit  > 

[COMmunications  -  TSPortation  -  LABor-  ADMistration  -  SANitation  ] 


Communications  Facilities  (COM):  Assess  the  communication  facilities  that 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

Transportation  Facilities  (TSP):  Assess  the  transportation  facilities  that  are 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

Administrative  Requirements  (ADM):  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 
Sanitation/Health/Medical  conditions  (SAN):  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


Read  this,  then  assign 
it  to  one  of  the  five 
criteria 

(do  30  of  these) 


IOB  Condition 


(9  subjects) 
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1/30 

i _ , 

The  environmental  protection  effort  in  Islandia  is  poorly  organized  hand  has  had  little 
effect.  Environmental  impact  is  not  a  consideration  in  any  awarding  of  construction 
permits. 

<C 

, - 1 

Read  this,  then: 


Assign  a  keyword 
Assign  it  to  a  criterion 
Evaluate  its  effect  on 
the  criterion 


[COMmunications  -  TSPortation  -  LABor-  ADMistration  -  SANitation  ] 

Communications  Facilities  (COM):  Assess  the  communication  facilities  that 
are  available  in  Islandia,  including  land  telephone  systems,  radio,  TV,  cellular 
phone  availability  and  coverage,  etc. 

Transportation  Facilities  (TSP):  Assess  the  transportation  facilities  that  are 
available  in  Islandia,  including  roads,  docks,  airports,  etc. 

Labor  Pool  (LAB):  Assess  the  labor  pool  that  would  be  available  to  staff  the 
camp  in  Islandia,  including  size  of  the  pool,  quality  of  workers,  work 
ethic/tradition,  etc. 

Administrative  Requirements  (ADM):  Assess  the  administrative  requirements 
needed  to  set  up  the  camp  in  Islandia,  including,  permits,  fees,  environmental 
considerations,  bureaucratic  red  tape,  graft,  bribes,  etc. 
Sanitation/Health/Medical  conditions  (SAN):  Assess  the  sanitation,  health  and 
medical  conditions  expected  in  Islandia,  including  drinking  water,  sewerage 
disposal,  medical  facilities,  infectious  diseases,  etc. 


(This  experiment  uses  only  the 
subjective  assessment  of  EFFECT 
does  not  tap  Importance, 
Credibility,  etc.) 


lOBs  Explained 
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INSTRUCTIONS 

You  have  now  evaluated  all  30  items.  Your  last  task  is  to  assign  rating  scores  to  each  criterion,  as  well  as  one 
final  overall  rating.  Your  previous  scoring  of  the  items  has  been  used  to  create  an  "Information  Object"  (IOB)  for 
each  information  item. 

This  IOB  includes  the  information  you  previously  assigned,  i.e.  the  keywords,  the  criterion  and  the  rating.  The 
keywords  are  hyperlinked  to  the  original  text  item  so  that  you  can  call  it  up  for  review  by  simply  clicking  on  the 
keywords.  When  you  do  this,  the  text  will  appear  in  a  window  to  the  right  of  the  display.  The  effect  you  selected 
for  each  item  is  represented  by  the  color  bar  in  the  IOB.  A  sample  IOB  is  presented  below: 

Your  Keyword 
Your  criterion  Assignment 
Your  assessment  of  the  Effect 
on  selecting  Islandia 

The  IOB  items  are  available  to  you  for  review  using  a  drop-down  sorting  menu  that  can  present  all  the  lOBs 
associated  with  all  the  criterion  oryou  can  elect  to  see  only  the  lOBs  associated  with  one  individual  criterion. 


View: 

iaii  a 

All  > 

i 

Communications 

Coi 

Transportation 

Labor  ! 

Administration 

68:. 

Sanitation 

Go 


How  to  sort  your  data 


Decision  Display:  IOB 
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Click  on  the  hyperlinked  titles  in  the  IOB  to 
display  the  original  text  here. 


Hyperlinked 


Decision  Display:  Text 
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Vie*:  All 
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Ower^i  Rerommend-rtion: 
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The  items  the  subject 
assigned  to  the 
Communications 
criterion 


IOB  Subjective  Assessment 


SflAWAR 

V 

Systems  Center 
San  Dieg  o 


One  Last  Request:  Please  select  one  of  the  options  below  in  terms  of  how  useful  the  lOBs 
were  in  making  your  scoring  decision  (this  would  be  as  versus  just  seeing  the  text  listing 
of  the  items  you  assigned  to  each  criterion) 


Somewhat 

distracting 

No  Effect 

Helped 

Somewhat 

Helped  a  lot 

r 

r 

r 

r 

Submit 

Positive  vs  Negative 
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%  of  Subjects  should  make 
a  decision  that  is  Positive: 

3  of  5  criteria  are  Positive 


V2  of  Subjects  should  make 
a  decision  that  is  Negative: 

3  of  5  criteria  are  Negative 


Positive  Criterion:  4  of  the  6  statements  are  positive 
Negative  Criterion:  4  of  the  6  statements  are  negative 


RESULTS 
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Subjective  Assessment 
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□  Max  =  9 
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Distract  No  Effect  Somewhat  A  Lot 


lOBs  HELP? 
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Time  Factor 
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25 


Classify  the  30  Make  the  6  decisions 


IOB  subjects  took  an  average  18  seconds  longer 
per  item  to  enter  keyword  and  make  evaluation 


TIME  TO  MAKE  DECISIONS 
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Significant  Difference 


Score  Assignment  to  Criteria 
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□  TEXT 
■  IOB 


Errors: 
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•  All  criteria  should  have  been  scored  as  either 

positive  or  negative 

-  Assignment  of  a  neutral  rating  is  scored  as  an  error 

-  For  the  IOB  subjects,  whether  the  correct  decision 
was  Positive  or  Negative  was  based  on  the  subject’s 
ratings 

-  For  the  Text  subjects,  correct  decision  was  based  on 
experimenter’s  classification 


-  Reversal  Error  (most  serious):  Positive  group  of 
information  given  a  Negative  rank  (or  vice  versa) 
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Bottom  Line: 
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Correct  Overall  Decision 


□  Max  #  9  67% 

(zero!) 

Text 


IOB 
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•  No  members  of  the  Text  group  made  a 
correct  Overall  decision: 

-  Preferred  the  neutral  rating 

•  Six  of  the  nine  IOB  group  made  a  correct 
Overall  decision 

•  Subjects  took  longer  to  make  a  decision 
when  preponderance  of  data  was  Positive 

•  IOB  subjects  gave  favorable  ratings  to  use 
of  lOBs  in  decision  making 
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Preliminary  Follow-up  DataX 


•  36  Subjects  at  Colorado  State 

•  Rank  Order  3  companies  in  terms  of  a  good 
stock  investment 

-  Standardized  test  used  in  other  studies 

•  Compare  decision  performance  of  subjects 
who  used  IOB  subjective  assessment  color  bar 
(Effect  and  Importance)  vs.  those  that  did  not. 


1 2%  over  netf  5 
years 

Did  not  use 

High  And  iUiblB- 
volume  of  salts. 
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Use  of  Subjective  Assessments 
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□  Used  Assmt 
M  No  Assmt 

Used  Assmt.  N=15 
No  Assmt.  N=21 
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